Heuristic and optimal policy computations in the human brain during sequential decision-making
نویسندگان
چکیده
منابع مشابه
Convergence in a sequential two stages decision making process
We analyze a sequential decision making process, in which at each stepthe decision is made in two stages. In the rst stage a partially optimalaction is chosen, which allows the decision maker to learn how to improveit under the new environment. We show how inertia (cost of changing)may lead the process to converge to a routine where no further changesare made. We illustrate our scheme with some...
متن کاملStructure Learning in Human Sequential Decision-Making
Studies of sequential decision-making in humans frequently find suboptimal performance relative to an ideal actor that has perfect knowledge of the model of how rewards and events are generated in the environment. Rather than being suboptimal, we argue that the learning problem humans face is more complex, in that it also involves learning the structure of reward generation in the environment. ...
متن کاملOptimal policy for value-based decision-making
For decades now, normative theories of perceptual decisions, and their implementation as drift diffusion models, have driven and significantly improved our understanding of human and animal behaviour and the underlying neural processes. While similar processes seem to govern value-based decisions, we still lack the theoretical understanding of why this ought to be the case. Here, we show that, ...
متن کاملOptimal sequential decision-making in liver resection and transplantation
The present investigation aims at the construction of a sequential decision procedure derived from a partially observable Markov decision process (POMDP) model. An optimal clinical management strategy based on a risk assessment of patients is to be found. A decision theoretic cost model different from the general approach has been selected for this clinical management (and classification) task:...
متن کاملNeural computations underlying action-based decision making in the human brain.
Action-based decision making involves choices between different physical actions to obtain rewards. To make such decisions the brain needs to assign a value to each action and then compare them to make a choice. Using fMRI in human subjects, we found evidence for action-value signals in supplementary motor cortex. Separate brain regions, most prominently ventromedial prefrontal cortex, were inv...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Nature Communications
سال: 2018
ISSN: 2041-1723
DOI: 10.1038/s41467-017-02750-3